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Abstract 

Although several scales are used to measure general and clinical learning climates, there are no scales 
that assess the preclinical learning climate. Therefore, the purpose of this study was to develop an effective 
measurement tool in order to assess the preclinical learning climate. In this cross-sectional study, data 
were collected from 3,540 preclinical medical students of six medical faculties in Turkey. The methodology 
included the following activities: generate an item pool, receive expert opinions, perform a pretest to purify 
the instrument, and conduct factor and reliability analyses. According to the factor analysis, eight factors were 
determined and their contribution to the variance was 50.39%. In addition, the item factor loadings ranged from 
.31 to .91, Cronbach's alpha coefficients for the subscales ranged from .72 to .77, and the item-total correlation 
coefficients for the subscales ranged from .44 to .76. All the items significantly discriminated between the low- 
and high-performing students [t = 99.57; p = .01). The scale included 52 items with the following subscales: 
management, teaching, teaching staff, institutional commitment, emotions, inter-student relationships, 
physical environment, and motivation. The analysis of this newly developed Preclinical Learning Climate Scale 
(PLCS) indicated that its psychometric properties are appropriate and this scale can be employed to evaluate 
medical education programs. 
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Learning climates are important as they directly 
influence the learners’ work within them (and 
vice versa) and provide a measure to determine 
the effectiveness of such climates in educational 
institutions (Dornan, Mann, Scherpbier, Spencer, & 
Norman, 2011). This topic has been one of the main 
subjects of focus in previous evaluations of medical 
education programs (Kennedy, Lilley, Kiss, Littvays, 
8c Harden, 2013; Soemantri, Herrera, 8c Riquelme, 
2010; WFME Standards, 2003). Learning climate 
has been defined as the quality of the learning 
environment as perceived by teaching staff and 
students (Genn, 2001). When students attend a 
new educational institution, they not only become 
acquainted with the curriculum but also become 
aware of the learning climate when they take exams, 
attend classes, or participate in activities (Dornan 


et al., 2011; Roff 8c McAleer, 2001). In this regard, 
the curriculum’s structure and its management, the 
educational-social activities offered to the students, 
and the schools relationship with the environment 
all shape the schools learning climate (Demiral 
Yilmaz, 2010; Roff 8c McAleer, 2001). Thus, by 
measuring the learning climate, an educational 
program can be evaluated to identify its positive 
and negative aspects (based on the opinions of 
teaching staff and students), following which inter- 
institutional comparisons can be performed and 
overall improvements can be achieved (Dornan et 
al, 2011). 

An examination of recent medical educational 
environment instruments reveals that there are 
many differences between educational institutions. 
These differences are in part attributable to the fact 
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that the instruments were often tailored to a specific 
setting of interest (Schonrock-Adema, Bouwkamp- 
Timmer, van Hell, & Cohen-Schotanus, 2012). 
As shown in Figure 1, recent scales have accessed 
the overall learning climate, the individual clinical 
phase, or certain themes that can influence the 
learning climate. The scales that have accessed 
the overall learning climate include the Medical 
Student Education Environment Measure (MSLES) 
(Marshall, 1978); the scale developed by Polali and 
Price (2000); the Medical Education Environment 
Measure (MEEM) (Roff, McAleer, Harden, & Al- 
Qahtani, 1996); and the Dundee Ready Education 
Environment Measure (DREEM) (Roff, 2005; Roff 
et al., 1996; Roff et aL, 1997). The MSLES was the 
first measurement tool used to evaluate the learning 
climate among medical students. The DREEM, 
another widely used scale to assess undergraduate 
medical education, distinguishes the learning 
environment in traditional medical schools from 
the learning environment in innovative medical 
schools and measures both clinical and preclinical 
phases in a program (Dornan et al., 2011; Soamentri 
et al., 2010). This tool was previously employed in a 
study on medical students in Turkey (Demiroren, 
Palaoglu, Kemahli, Ozyurda, & Ayhan, 2008). 
Furthermore, some scales are specific to clinical 
education such as the Clinical Learning Climate 


Scale (CLCS) (Demiral Yilmaz, 2010; Wangsaturak 
& McAleer, 2008), the Manchester Clinical 
Placement Index (MCPI) (Dornan et al., 2011), and 
the Undergraduate Clinical Education Environment 
Measure (UCEEM) (Strand et al., 2013). However, 
no scales specifically measure the preclinical learning 
climate in undergraduate medical education. 

It is impossible to conduct clinical studies without 
performing preclinical studies in undergraduate 
medical education. The basic difference between 
the two learning climates is the transition from the 
preclinical phase to the clinical phase. Although the 
main objectives in the preclinical phase are to foster 
learning through small or large group activities and 
provide assessments of the students’ competency, 
the overall objective in the clinical phase is to learn 
by participating in daily practices (Dornan et al., 
2011; Riley, 2009). 

To date, in order to ensure vertical and horizontal 
integration, medical training programs have 
undergone several changes. More specifically, 
the preclinical period currently includes learning 
activities such as early clinical contact, simulation 
practice, and skills labs, while the clinical period 
consists of basic medical science courses in 
addition to the clinical applications (Cate, 2007; 
Harden & Davis, 1995; McClean, 2004). Despite 


Preclinical Phase (6 semesters) Clinical Phase (6 semesters) 



CLCS, MCPI, UCEEM 


NONE 


1505 


4 


Figure 1 : Scales used to assess the learning climate in medical education programs. 
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these efforts, the preclinical period continues 
to bear its distinctive features. These differences 
between the two phases can change the learning 
climate and affect the students. During the clinical 
stage, which is known to be a major source of stress 
for students (Dahlin & Runeson, 2007; Sandars, 
Patel, Steele, 8c Mcareavey, 2014), the students 
become more involved as future members of the 
profession. However, this is not the case for the 
preclinical phase. Although it has been shown that 
it is important to assess the learning environments 
of each phase of undergraduate medical education 
(Soemantri et al., 2010; Wangsaturak 8c McAleer, 
2008), the purpose of the present study was to 
develop a measurement tool to specifically assess 
the learning climate of the preclinical stage. 

Methods 

This cross-sectional study focused on six well- 
established medical faculties in four different 
geographical regions of Turkey. In Turkey, 
medical education generally lasts for six years 
(12 semesters), with the first three years as the 
preclinical phase and the second three years 
as the clinical phase. During the preclinical 
phase, medical students acquire basic medical 
knowledge and skills in simulated environments 
in order to prepare themselves for the clinical 
phase. Teaching is primarily through classroom 
lectures and practical applications in small groups. 
During the clinical phase, students develop their 
medical knowledge and skills through clinical 
rotations based on their preclinical learning. These 
education programs are structured in such a way 
as to allow the horizontal and vertical integration 
of both phases. Among the six medical faculties 
participating in this study, two implemented a 
problem-based learning (PBL) program, whereas 
the other four implemented a system-based 
integrated program. During the development of 
the scale, there was no predetermined sample size. 
Thus, all of the preclinical students (N = 5,833) 
in the aforementioned six medical faculties were 
included in this study. 

Development of the Instrument 

This Preclinical Learning Climate Scale (PLCS) was 
developed in five stages. While the validity analysis 
(content, construct) was carried out in the first four 
stages, the reliability analysis was conducted in the 
fifth stage. 


Literature Review and Generation of the Item 
Pool: In Stage 1, a literature review was performed 
by the research team. In addition, the feedback 
collected from the participating students in the 
preclinical phase was taken into account. The 
students’ feedback focused on various aspects such as 
their opinions regarding their educators, theoretical 
and practical educational activities, educational 
resources, learning motivation, information, and 
social facilities. Based on the literature review and 
the feedback data, a conceptual framework related 
to the learning climate (teaching, learning experience, 
educational resources, success, human relations, 
educators, assistant educators, emotions, health and 
stress, motivation, and management) was determined 
and the item pool was generated. Consensus 
regarding the items to be included in the initial 
version of the instrument was established using the 
Delphi panel technique. For this approach, the list of 
items was electronically sent to the researchers of this 
study by the principal researcher. The researchers 
were then requested to assess the appropriateness of 
the items with a standard form in accordance with 
certain criteria (i.e., whether the items represent the 
property to be measured, whether the items can be 
understood by the target population, whether the 
statements are clear enough, and whether the items 
are relevant to the conceptual framework). This 
technique was repeated three times until a consensus 
on the items was reached. As a result, the initial 
version of the instrument was developed. 

Expert Review Panel: In Stage 2, in order to 
determine the content validity of the initial 
version of the instrument, 10 outside experts 
(nine postgraduates in medical education and one 
psychologist) from different medical education 
departments were consulted. After the initial version 
of the instrument was developed, the expert panel 
evaluated the scale to determine whether it was 
consistent with the purpose of the study. The experts 
were then requested to evaluate each item of the 
initial version of the instrument as “appropriate” or 
“not appropriate” in accordance with the criteria used 
in the Delphi panel. They were also asked to provide 
any suggestions for the items that they considered 
“not appropriate.” Based on the experts’ opinions, 
the content validity ratio (CVR) for each of the items 
in the scale was calculated using Lawshe’s technique 
(Lawshe, 1975). In this technique, if the number 
of experts is 10, then the CVR is expected to be a 
minimum of .62 at the a = .05 level of significance 
(Veneziano & Hooper, 1997). Thus, the preliminary 
instrument was developed with a calculated CVR 
score that was over .62. 
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Instructions describing the purpose of the scale 
and the how the items are marked were provided 
with the preliminary instrument. The preliminary 
instrument utilized a five-point Likert scale ranging 
from 1 (strongly disagree) to 5 (strongly agree). 
An assessment expert examined the style of the 
preliminary instrument while a Turkish linguist 
evaluated the clarity of the language. In Stages 
1 and 2, the content validity of the preliminary 
instrument was also examined. 

Pretest and Purification of the Instrument: In 

Stage 3, the preliminary instrument was given to a 
group of student volunteers (n = 20) who evaluated 
the items in terms of meaningfulness, readability, 
comprehensibleness, sentence length, and clarity of 
meaning. At a subsequent meeting, two researchers 
obtained the students views (both orally and in 
writing) following which their opinions were 
evaluated by the research team. After the pretest, 
the preliminary instrument was deemed ready for 
implementation. 

Data: The preliminary instrument was given to 
the preclinical students in the medical faculties 
between April 2012 and May 2012. Prior to 
the application of the scale, the students were 
informed about the purpose of the study and the 
confidentiality of their personal data, following 
which their consents were obtained. The collected 
data were entered into a standard database by the 
researcher(s) in the relevant faculty. After data 
quality control was performed, any surveys with 
missing values were removed. The final data were 
gathered and analyzed. 

Factor Analysis: In Stage 4, the construct validity 
of the preliminary instrument was examined with 
exploratory factor analysis (EFA). The Kaiser- 
Meyer-Olkin (KMO) and Bartlett’s test of sphericity 
was conducted to determine whether the factor 
analysis was applicable (Sharma, 1996). During 
the EFA, the number of subscales in the scale was 
determined via the principal components analysis 
and the Promax rotation method. Based on the 
rule that the sample size of an item with a factor 
loading of .30 should be at least 350 (Hair, Tatham, 
Anderson, & Black, 1998), the cut-off point for the 
factor loading values was accepted as .30. 

At the conclusion of Stage 4, the definitive 
instrument was developed by testing the construct 
validity of the scale. Discriminant validity analysis 
was conducted to support the construct validity of 
the data collected with the definitive instrument. 
During this assessment, the mean scores obtained 
by the students from the instrument were compared 


in terms of the following variables: curriculum, 
their year in the faculty, whether they failed a class 
and repeated it, whether it was their own decision 
to attend the medical faculty, their academic grade 
point averages, and their perceptions of success. 

Reliability Analysis: In Stage 5, the reliability analysis 
of the definitive instrument was performed. In 
order to determine the reliability of the instrument, 
Cronbach’s alpha coefficient was calculated. The 
cut-off point for Cronbach’s alpha coefficient was 
accepted as .70 (Nunnaly, 1978). To investigate the 
relationship between each item and the total score of 
the scale, the item-total correlations were calculated. 
In addition, to assess the discrimination of each 
item on the scale, the top and bottom 27% of the 
groups that received the highest and lowest scores, 
respectively, were compared. 

To evaluate the validity evidence in this study, five 
headings published by The American Psychological, 
Education Research Associations and National 
Council on Measurement in Education were used 
(AERA-APA-NCMA, 1999). First, content validity 
evidence was obtained from the data generated 
through the literature review, preclinical students’ 
feedback, item pool, Delphi panel, and expert review 
panel. Validity evidence based on the response 
process was obtained from the data generated from 
the sample method, response rate, self-reported 
method, informed consent, anonymous response, 
five-point Likert scale, data quality control, and 
standard database. Validity evidence based on 
the internal structure was obtained from the data 
generated through EFA, Cronbach’s alpha, item- 
total correlation, and item discrimination. Validity 
evidence based on the relation to other variables was 
obtained from the data on observed and expected 
scores, and discriminant analysis. Finally, to 
obtain evidence based on consequences, the reports 
recorded in each stage of the research were shared 
and evaluated by the researchers. 

At the end of the five stages, the validity and 
reliability of the scale were established, the subscales 
were identified, and the min-max scores for the 
scale and subscales were determined. There was 
no cut-off point for the scores obtained from the 
scale. Scores that were closer to the maximum score 
indicated that the learning climate was positively 
perceived. Moreover, the statistical analysis was 
performed using PASW Statistics software for 
Windows (SPSS, Inc., IBM) Version 18.0. 
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Ethical Considerations 

This study was approved by the Ethics Committee 
of the Ege University Faculty of Medicine (Decision 
Number: 11-6.1/10,) and all the students’ written 
and verbal consents were obtained. There were no 
conflicts of interest in this study. 

Results 

Characteristics of the Study Group 

Among the 5,833 preclinical students attending the 
six medical faculties in this study, 61% (n = 3,540) 
responded to the preliminary instrument. The mean 
age of the students in the study group was 20 ± 1.45 
years (min = 17-max = 36). Among the students, 54% 
were male, 38% were first-year students, 32% were 
second-year students, 29% were third-year students, 
6% failed a class and repeated it, and 85% willingly 
chose the medical school. Regarding their academic 
grade point averages, 7% of the students had less 
than 59, 86% had between 60 and 84, and 7% had 85 
and higher. Finally, 17% of the students considered 
themselves “not successful,” while 52% stated that 
they were “moderately successful” and 31% felt that 
they were “successful.” Figure 2 presents the algorithm 
related to the development process of the PLCS, which 
lasted for two years (June 2011-June 2013). 


Initial Version of the Instrument 

Upon completion of the literature review, a 235- 
item pool was generated. The researchers reached 
a consensus on 85 items (at the end of the third 
round of the Delphi panel), and the initial version 
of the instrument was based on this material. 

Preliminary Instrument 

In order to examine the content validity of the 
initial version of the instrument, 10 outside experts 
were consulted, and the content validity ratio 
(CVR) was calculated for each of the items in the 
scale. It was found that the CVR for 64 of the 85 
items in the initial version of the instrument was 
above .62. The other 21 items were excluded on 
the basis of the experts’ opinions. The preliminary 
instrument only included the items whose CVR 
was over .62. An assessment expert examined 
the preliminary instrument, and according to the 
Turkish linguist, it required no revisions and it 
was ready for pretesting. The content validity of 
the preliminary instrument was established after 
the Delphi and expert panels. In total, 20 medical 
student volunteers participated in the pretesting 
phase of the preliminary instrument (64 items). 
The students stated that the items in the scale were 
meaningful, readable, and understandable. They 



Delphi Panel 
J3rounds^ 



Generation of item pool 


if 


if 


if 


if 


Initial version of the instrument 
(85 items) 


Preliminary instrument 
(64 items) 


Preliminary instrument 
(64 items) 


Definitive instrument 


Preclinical Learning 
Climate Scale (52items) 


Figure 2: Development process of the PLCS. 
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Table 1 

Factor Structure of the Preliminary Instrument 


Factors 

Communalities 

Eigenvalues 

Percentage of Total 
Variance Explained 

Cumulative Percentage of 
Total Variance Explained 

Factor Loadings 

FI 

0.42-0.60 

12.78 

24.58 

24.58 

0.77-0.38 

F2 

0.40-0.62 

2.92 

5.62 

30.20 

0.79-0.38 

F3 

0.48-0.63 

2.56 

4.93 

35.13 

0.79-0.41 

F4 

0.38-0.68 

2.15 

4.13 

39.26 

0.71-0.32 

F5 

0.38-0.77 

1.66 

3.20 

42.46 

0.91-0.41 

F6 

0.34-0.63 

1.60 

3.07 

45.53 

0.81-0.49 

F7 

0.31-0.62 

1.38 

2.65 

48.18 

0.76-0.31 

F8 

0.48-0.77 

1.15 

2.21 

50.39 

0.89-0.39 


also considered the scale appropriate in terms of 
sentence length. Based on these evaluations, the 
instrument was deemed ready for implementation. 

Definitive Instrument (Factor Analyses) 

To determine the construct validity of the scale, 
the values for the KMO (.95) and Bartlett’s test of 
sphericity (X 2 : 69484.88; p < .00) were considered 
significant, and it was accepted that the survey data 
were appropriate for the factor analysis. In order to 
decide the number of factors in the scale, exploratory 
factor analysis (EFA) was applied to the 64 items, 
and the eigenvalues, percentage of total variance 
explained, and factor loadings were examined. Based 
on the EFA, eight factors were obtained. The total 
contribution of the eight factors to the variance was 
found to be 50.39%. The factor loadings of the items 
with eigenvalues higher than 1.15 varied between .31 
and .91. The eigenvalues, percentage of total variance 
explained, and factor loadings of the factors in the 
scale are presented in Table 1. 

The resulting eight factors were evaluated in terms 
of content integrity, following which the following 
subscales were established: management, teaching, 
teaching staff, institutional commitment, emotions, 
inter-student relationships, physical environment, 
and motivation. When the subscales were named, 


logical and semantic relationships between the 
items were taken into account and the entire 
conceptual framework was included. 

Based on the responses given by the preclinical 
medical students during the development stage 
of the PLCS, the expected min-max scores and 
observed mean scores of the scale and subscales 
were obtained (Table 2). 

The ratio of the observed mean score to the expected 
max score obtained from the scale ranged from 54% 
to 77%. Although the observed mean score close to 
the expected maximum score of the scale indicates 
that preclinical learning climate was perceived 
positively, the observed mean score close to the 
expected minimum score of the scale indicates the 
problematic areas of the learning climate. 

Based on the EFA, 12 items were removed from 
the scale since their factor loadings were under 
.30, which was considered the threshold value. 
Construct validity of definitive instrument was 
established, following which the subscales (and the 
items under each subscale) were renumbered. The 
resulting instrument, the PLCS, includes 52 items, 
four of which are reversely scored (Items Nos. 45, 
46, 47, and 54). 

Upon completion of the discriminant validity 
analysis, it was determined that the instrument 


Table 2 

The Number of the Items in the Subscales and the Subscale Scores 

Factors 

Subscales 

The Number of the Item 

Min-Max Score 

Observed Mean Score (SD) 

FI 

Management 

7 

7-35 

18.95 (5.21) 

F2 

Teaching 

11 

11-55 

32.84 (7.00) 

F3 

Teaching Staff 

9 

9-45 

29.57 (5.46) 

F4 

Institutional Commitment 

7 

7-35 

21.60 (5.46) 

F5 

Emotions 

5 

5-25 

14.03 (4.43) 

F6 

Inter-Student Relationships 

5 

5-25 

15.78 (3.36) 

F7 

Physical Environment 

5 

5-25 

16.11 (3.48) 

F8 

Motivation 

3 

3-15 

11.49 (2.32) 

Total PLCS score 

52 

52-260 

160.37 (26.07) 
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Table 3 


Distribution of the PLCS Scores in terms of Independent Variables 

Independent Variables 


N 

Mean 

SD 

t/F 

p 

Faculty educational program type 

Problem-based learning 

1126 

165.48 

25.45 


0.00 

System-based integration 





2414 

157.98 

26.01 




1 

1357 

167.00 

24.78 



Year at school 

2 

1140 

158.43 

25.63 

83.41** 

0.00 


3 

1043 

153.85 

26.21 



Repeating the class 

Yes 

200 

155.57 

28.18 

2.69* 

0.01 

No 

3340 

160.66 

25.91 




Yes 

3013 

161.96 

25.45 



Choosing the faculty on his/her own 

will 




8.29* 

0.00 

No 

527 

151.26 

27.66 




<59 

237 

155.63 

26.66 



Academic grade point average 

60-84 

3050 

160.21 

25.98 

11.65** 

0.00 


85-100 

253 

166.76 

25.51 




Not successful 

591 

149.43 

27.36 



Perception of success 

Moderately 

successful 

1849 

159.21 

24.38 

109.75** 

0.00 


Successful 

1100 

168.19 

25.67 




* f-test 

** One-way ANOVA 


could discriminate the students according to the 
following independent variables: curriculum, year 
at school, repeating the class, choosing the faculty 
on his/her own will, academic grade point average, 
and perception of success (Table 3). 

Preclinical Learning Climate Scale 

For the internal consistency analysis, Cronbachs 
alpha coefficient was .94, while the Cronbachs 
alpha coefficients of the subscales ranged from .72 
to .77. The item-total correlation coefficients of the 
subscales were found to be between .44 and .76. All 
the items significantly discriminated between low- 
and high-performing students (t = 99.57; p = .01). 
Based on the results of the analysis, the PCLS was 
found to be a reliable scale. 

In Table 4, the items of the PLCS are presented 
according to the factor loadings of the subscales 
determined through the EFA. In addition, 
Cronbachs alpha (a) and the item-total correlation 
coefficient (r) of each subscale are given. 

As a result of the analysis, the 52-item PLCS, 
comprising eight subscales, was developed and the 
validity and reliability of the scale were established. 
The possible minimum and maximum scores 
obtained from the scale were 52 and 260, respectively. 

Discussion 

In this study, the Preclinical Learning Climate 
Scale (PLCS) was developed to determine medical 

^ 1510 


students’ perceptions of the preclinical learning 
climate. The methodology, recommended by 
McKenzie, Wood, Kotecki, Clark, and Brey (1999), 
Delamere, Wankel, and Hinch (2001), Worthington 
and Whittaker (2006), and Ringsted, Hodges, and 
Scherpbier (2011) included the following activities: 
generate an item pool, receive expert opinions, 
perform a pretest to purify the instrument, and 
conduct factor and reliability analyses. 

In general, content validity plays an important 
role in the assessment of the validity criteria 
when developing any type of scale. To achieve this 
purpose, the present study conducted a literature 
review, observations and discussions with experts, 
qualitative and quantitative content evaluations, 
structured/unstructured observations, focus 
groups, etc. (Soemantri et al., 2010). In addition, 
content validity evidence was obtained through 
the literature-based item pool, the Delphi panel 
technique, and outside expert opinions. 

Factor analysis is a fundamental step in 
demonstrating the construct validity when 
developing any scale (DeVellis, 2003; Johnson & 
Wichern, 2002; Tabachnick & Fidell, 2001). In the 
present study, the construct validity of the scale 
was demonstrated through exploratory factor 
analysis. In addition, the total contribution of the 
eight factors to the variance was 50.39%. According 
to Scherer, Wiebe, Luther, and Adams (1988), the 
percentage of total variance between 40% and 60% 
is appropriate in multifactorial designs. Thus, the 
contribution of the aforementioned eight factors to 
the total variance was appropriate in this study. 
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Table 4 

The Subscales of the PLCS Determined according to Factor Loadings 


c , , Item-total 

Subscale , .. 

correlation 

Items 

0.56 

0.57 

Management 
a = 0.73 0.51 

r = 0.73 0.44 

0.53 

0.58 

62. The consulting services provided for the students in the school are sufficient. 

60. At the school, the students can voice their concerns in the decision-making process. 

61. The school administration takes into account the feedback from the students. 

59. The school also provides opportunities for students to become involved in non-medical pursuits. 
43. The student affairs unit at the school displays a supportive attitude toward students. 

32. The school administration is closely concerned with the students’ problems. 

63. The quality of the education is of importance to the school administration. 

0.49 

4. The teaching is conducted in a manner that provides the skills necessary to serve in my profession. 

0.53 

3. The teaching is conducted in a manner that provides the knowledge necessary to serve in my 
profession. 

0.51 

0.57 

2. The teaching encourages me to become an active learner. 

12. The teaching ensures the development of my critical thinking and evaluation skills. 

Teaching °' 48 

a = 0.7 2 
r = 0.75 

0.50 

0.63 

0.51 

0.52 

5. The teaching is conducted in a manner that provides the attitudes and behaviors necessary to 
serve in my profession. 

I. The students clearly know what they are supposed to learn. 

II. The recommended learning resources are helpful for the students. 

13.1 feel that I am receiving quality training. 

23. The contents of the exams focus on topics that I will use in my profession. 

22. The students know what is expected of them in the exams. 

0.40 

10. The students are informed about the learning resources (i.e., books, presentations, electronic 
resources, etc.) that we need to use in advance. 

0.46 

0.39 

0.49 

34. The teachers are prepared for their classes. 

35. The teachers are knowledgeable about their area of specialization. 

40. The teachers behave respectfully toward the students. 

Teaching staff ®-57 

a = °- 73 0.54 

r = 0.73 

0.51 

0.53 

0.56 

0.52 

38. The teachers feel responsible for encouraging students to learn. 

36. The way that the teachers provide training is good. 

41. The teachers believe that students can be successful. 

39. The teachers are open to students’ different opinions and ideas. 

33. The teachers are willing to take part in the students’ training. 

42. The students have easy access to teachers when needed. 

0.62 

0.61 

Institutional o.66 

commitment _ ,. 

a = 0.73 °' 64 

r = 0.76 0.62 

0.41 

0.52 

58.1 am proud of my school. 

53.1 feel that I belong to my school. 

50.1 am pleased to be a student in this school. 

52.1 feel valuable in the school. 

51.1 feel that I am generally trusted in the school. 

54. This school has disappointed me. 

64.1 feel safe on campus and in the hospital. 

0.35 

Emotions 

a = 0.75 0.33 

r = °- 50 0.60 

0.48 

45. During this academic year, I feel depressed. 

46. During this academic year, I feel angry. 

47. During this academic year, I feel anxious. 

49. During this academic year, I generally feel good. 

48. During this academic year, I have been able to allocate time for myself. 

0.37 

Inter-student o.52 

relationships ^ ^ 

a = 0.76 

r = 0.57 0.37 

0.39 

25. The students in the classroom know one another. 

26. There is a positive/relaxing atmosphere in our classroom. 

27. In our school, the students behave respectfully toward one another. 

30. There is a supportive relationship between the junior and senior students in the school. 

28. There is an environment for students to get together in the school. 

0.43 

0.36 

Physical Q 43 

environment 
a = 0.75 

r = 0.57 0.38 

18. The school provides convenient and comfortable study areas for the students. 

17. The locations (i.e., classrooms, labs, learning resource center, etc.) that I make use of are clean. 

15. The learning resources (i.e., printed or electronic documents, manikins, models, etc.) are 
provided by the school so that the students can easily access them. 

19. The locations used for purposes other than education (i.e., canteen, cafeteria, toilets, etc.) meet 
the needs of the students. 

0.41 

44. The school staff (i.e., laboratory workers, cleaners, canteen staff, etc.) display supportive attitudes 
toward the students. 

Motivation 0-31 

a = 0.77 0.31 

r = 0.44 o.57 

56.1 am willing to learn about topics related to my profession. 

55.1 want to become a physician. 

57. The teaching ensures the development of my professional self-confidence. 
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Hair et al. (1988) recommended a certain sample 
size for factor loading values. The sample size in the 
present study is suitable since the cut-off value of 
.30 was used to determine factor loads. When the 
items included in the sub-scales are evaluated from 
this perspective, they are considered to have been 
sufficiently loaded. 

The eight-subscale model included the following 
factors: 

Management: This factor examines the learning 
climate from the perspective of education 
management, which includes administrative 
features such as allowing students to participate in 
the decision-making process, dealing with students’ 
problems, and providing support and counseling. 

Teaching. This factor focuses on the teaching strategies 
and the impact of measurement-assessment activities 
on students and the learning climate. 

Teaching staff. This factor investigates educators’ 
versatile and challenging roles (other than the transfer 
of information) that affect the learning climate. 

Institutional commitment: This factor includes 
items related to students’ sense of belonging to their 
institution. 

Emotions: This factor assesses students’ affective 
perceptions of the learning environment. 

Inter-student relationships: This factor assesses the 
effects of trust, value, and communication on the 
learning climate, especially in terms of intra-class 
and intra-faculty interactions. 

Physical environment: This factor focuses on 
the location of educational activities, learning 
resources, and logistical support, all of which have 
an effect on the learning climate. 

Motivation: This factor examines the impact of the 
learning environment on motivation, in addition to 
the students’ intrinsic motivation. 

While the PLCS had similarities with some of the 
previously developed learning climate scales, it 
differed in terms of the names of the subscales. The 
following are the commonalities and differences 
between the PLCS and other learning climate scales: 

1) The teaching subscale is also included in the DREEM 
(Roff et al., 1997), the Practice-based Educational 
Environment Measure (PEEM) (Mulrooney, 
2005), and the Postgraduate Hospital Educational 
Environment Measure (PHEEM) (Roff, 2005). 

2) The teaching staff subscale is also included in 
several other scales. However, it is referred to as 


teachers in the DREEM (Roff et al., 1997) and the 
CLCS (Wangsaturak 8c McAleer, 2008), as coaching 
and assessment in the Dutch Residency Educational 
Climate Test (D-RECT) (Boor, van Der Vleuten, 
Teunissen, Scherpbier, 8c Scheele, 2011), as trainer 
and training in the Surgical Theatre Educational 
Environment Measure (STEEM) (Cassar, 2004), 
and as teaching and teachers in The Anaesthetic 
Theatre Educational Environment Measure 
(ATEEM) (Holt 8c Roff, 2004). 

3) The inter-student relationship subscale is referred 
to as student-interaction in the Medical School 
Learning Environment Questionnaire (LEQ) 
(Rothman 8c Ayoade 1970). 

4) The management subscale is referred to as 
organization And flexibility in the MSLES (Marshall, 
1978), and as student involvement (in curriculum 
etc.) and administratively flexible in the Medical 
School Environment Questionnaire (MSEQ) 
(Wakeford, 1981). 

5) The emotions subscale is referred to as academic 
enthusiasm in the LEQ (Rothman 8c Ayoade, 1970), 
as emotional climate in the MSLES (Marshall, 1978), 
and as enjoyable in the MSEQ (Wakeford, 1981). 

6) The physical environment subscale is referred to 
as physical environment and educational resources in 
the CLCS (Wangsaturak 8c McAleer, 2008). 

7) The motivation subscale is referred to as 
intellectual maturity in the LEQ (Rothman 8c 
Ayoade, 1970) and as motivation in the CLCS 
(Wangsaturak 8c McAleer, 2008). 

8) The institutional commitment subscale included 
in the PLCS is not included in the other scales nor 
is it referred to by any other name. 

When the PLCS is compared with other learning 
climate scales, two features distinguish it from 
the other scales. First, some items included in the 
subscales of the PLCS show a holistic structure. 
Second, the institutional commitment subscale is 
included as a new conceptual dimension in the 
learning climate. 

According to the discriminant validity analysis, 
the scores from the variables, such as the 
faculty education program type, year at school, 
repeating the class, choosing the faculty on his/ 
her own will, academic grade point average, and 
perception of success, differed significantly. This 
finding demonstrates that the differences between 
students according to these variables refer to its 
discrimination strength. This also supports the 
construct validity of the scale. 
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In the development of any scale, inter-rater reliability, 
item discrimination test, internal consistency, 
Cronbachs alpha, test-retest measures, and 
generahzability analysis are used to estimate overall 
reliability (Dornan et al., 2011). In the present study, 
Cronbachs alpha, item-total correlation, and the 
item discrimination test were conducted. It has been 
shown that a Cronbachs alpha coefficient of greater 
than .70 indicates high reliability (Munro, 2005). 
Since the Cronbachs alpha coefficient in the PLCS 
was above .70, this scale was deemed highly reliable. It 
has been recommended that the item-total correlation 
coefficient, which indicates the contribution of each 
item to the entire scale, should be at least .30 (Streiner 
& Norman, 2008). In the present study, the item-total 
correlation coefficient for all of the subscales was above 
.44, which suggests that the items included in each 
subscale were consistent with one another. Finally, 
according to the item discrimination test results, all 
of the items were significantly discriminated between 
the low- and high-performing students. All these 
findings indicate that the PLCS is highly reliable. 

In this study, validity evidence was assessed in 
accordance with the sources developed by The 
American Psychological Association (APA), the 
American Education Research Association (AERA), 
and the National Council on Measurement in 
Education (NCMA) (1999). The validity evidence 
obtained according to these criteria indicates that 
the PLCS is a valid and reliable instrument. 

The aforementioned findings concerning the 
validity and reliability of the scale indicate that the 
PLCS provides valid and reliable scores, and it can 
be used to assess medical students’ perceptions of 
the learning climate in the preclinical phase. The 
following are the strengths of the scale: 

1) It covers all observed factors that affect learning 
during the preclinical period; 

2) It includes items regarding students’ participation 
in the management process; 

3) It includes the teaching subscale with items such 
as identification of students’ needs, educational 
objectives and strategies, and sources related to 
testing and learning; 

4) It includes the institutional commitment subscale, 
which is unique to the scale; 

5) The scale was administered to a large sample 
group, which increased the evidentiary value of the 
validity and reliability analyses; 

6) The scale can measure the learning climate in 
medical schools with different education programs. 


Finally, in the literature (Cohen, 2006; Dornan et 
al., 2011), the importance and effects of the learning 
climate have been identified. However, since the 
learning climate covers all the variables that affect 
learning, researchers have focused on the different 
aspects of the learning climate, which has resulted 
in a number of scales with different dimensions. 
Therefore, the PLCS was structured to include all 
of the observed factors that affect learning in the 
preclinical stage in medical schools. It excludes 
no dimension regarding the learning climate, but 
includes the institutional commitment subscale, 
which is unique to the scale. 

Finally, this study includes several limitations. First, 
the findings are specific to the preclinical stage in 
medical schools and the scale cannot be used in 
other stages of medical education. Second, since 
the number of items in the scale is considerable, 
the time required to administer the scale can vary 
widely. Third, generahzability analysis, which 
analyzes the reliability of the evidence under 
specific conditions, was not conducted in this study. 
Therefore, future studies should further refine and 
evaluate the generahzability of this scale. 

Conclusions 

In this study, the primary reason why the new scale 
was developed, rather than using an established 
scale (e.g., the DREEM), is that previous scales 
cannot fully examine climatic factors that affect the 
educational environments in medical schools. Thus, 
the 52-item PLCS was developed as a measurement 
tool to assess the preclinical learning climate in 
medical schools. The scale included eight subscales: 
management, teaching, teaching staff, institutional 
commitment, emotions, inter-student relationships, 
physical environment, and motivation. The results 
suggest initial support for the new instrument 
as a measure of preclinical medical students’ 
perceptions of the learning climate. However, 
although the authors of this study recommend that 
the PLCS be used as a valid and reliable tool for 
the evaluation of the preclinical period in medical 
schools, they also suggest that future studies that 
plan to use the PLCS should perform confirmatory 
factor analysis and generahzability analysis in the 
case of applying the scale in different cultures. 
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